# Efficient Transfer Learning

Derm Foundation is a machine learning model designed to accelerate AI development for skin image analysis in dermatology applications.

TinyBERT is a lightweight BERT model developed by Huawei Noah's Ark Lab, which compresses the model size through knowledge distillation while maintaining high performance.

This is a distilled version of distilbert-base-multilingual-cased, specifically optimized for English and Ukrainian while maintaining the original model's accuracy.

This is a sparse pre-trained model that can be fine-tuned for various language tasks, reducing computational overhead through weight pruning.

This is a lightweight version of distilbert-base-multilingual-cased, supporting English and Greek while retaining the original model's semantic representation capabilities.